Systems and methods of check processing with background removal

ABSTRACT

An image of a check is captured by an imaging device and a digital image of the check on a replacement background may be created. The check may be placed on any background while the image of the check is being captured. The replacement background replaces, in the digital image, the background that the check is placed on while its image is being captured. The replacement background may comprise a predetermined image or color(s). The image of the check and the replacement background may be provided into a digital image file that may be transmitted to an institution system for deposit of the check into an account.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.12/397,930, filed Mar. 4, 2009, pending, which is hereby incorporated byreference herein.

BACKGROUND

Checks typically provide a safe and convenient method for an individualsuch as a payor to transfer funds to a payee. To use a check, theindividual usually opens a checking account, or other similar account,at a financial institution and deposits funds, which are then availablefor later withdrawal. To transfer funds with a check, the payor usuallydesignates a payee and an amount payable on the check. In addition, thepayor often signs the check. Once the check has been signed, it isusually deemed negotiable, meaning the check may be validly transferredto the payee upon delivery. By signing and transferring the check to thepayee, the payor authorizes funds to be withdrawn from the payor'saccount on behalf of the payee.

While a check may provide a payor with a convenient and secure form ofpayment, receiving a check may put certain burdens on the payee, such asthe time and effort required to deposit the check. For example,depositing a check typically involves going to a local bank branch andphysically presenting the check to a bank teller. To reduce such burdensfor the payee, systems and methods have been developed to enable theremote deposit of checks. For example, the payee may scan a check in adigital image using a scanner or other imaging device and a computingdevice. The financial institution may then receive from the payee thedigital image of the check. The financial institution may then use thedigital image to credit funds to the payee.

However, such a technique requires the efficient and accurate detectionof a check in the digital image. Detecting the check image anddistinguishing it from the background image in the digital image isdifficult.

SUMMARY

An image of a check is captured by an imaging device and a digital imageof the check on a replacement background may be created. The check maybe placed on any background while the image of the check is beingcaptured. The replacement background replaces, in the digital image, thebackground that the check is placed on while its image is beingcaptured. The image of the check and the replacement background may beprovided into a digital image file that may be transmitted to aninstitution system for deposit of the check into an account.

In an implementation, a replacement background may be determined basedon features of the background on which a check is placed for imagingand/or features of the check.

In an implementation, the difference may be determined between an imageof a check on a replacement background and the replacement background.The difference may be used to generate a digital image comprising onlythe check image or a digital image comprising the check image with areduced amount of replacement background present in the digital image.

In an implementation, the difference may be determined between an imageof a check on a background on which the check was placed while its imagewas captured and the background itself. The difference may be used togenerate a digital image comprising the check image without thebackground or with a reduced amount of background present in the digitalimage. In such an implementation, a replacement background may not beused.

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the detaileddescription. This summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing summary, as well as the following detailed description ofillustrative embodiments, is better understood when read in conjunctionwith the appended drawings. For the purpose of illustrating theembodiments, there are shown in the drawings example constructions ofthe embodiments; however, the embodiments are not limited to thespecific methods and instrumentalities disclosed. In the drawings:

FIG. 1 is a block diagram of an implementation of a system in whichexample embodiments and aspects may be implemented;

FIG. 2 is a diagram of an example image comprising check data andoriginal background data;

FIG. 3 is a diagram of an example image comprising check data andreplacement background data;

FIG. 4 is an operational flow of an implementation of a method that maybe used to detect a check;

FIG. 5 is an operational flow of another implementation of a method thatmay be used to detect a check;

FIG. 6 is an operational flow of another implementation of a method thatmay be used to detect a check;

FIG. 7 is an operational flow of another implementation of a method thatmay be used to detect a check; and

FIG. 8 is a block diagram of an example computing environment in whichexample embodiments and aspects may be implemented.

DETAILED DESCRIPTION

FIG. 1 is a block diagram of an implementation of a system in whichexample embodiments and aspects may be implemented. A user 105 is shownalong with an institution system 205. The institution system 205 may beaffiliated with an institution 200, which may be any type of entitycapable of processing a transaction involving a negotiable instrument,such as processing checks and/or providing funds associated with checks.For example, the institution 200 may be a financial services institutionsuch as a retail bank, an investment bank, an investment company, aregional branch of the Federal Reserve, a clearinghouse bank and/or acorrespondent bank. A representative 185 of the institution 200 mayprovide assistance.

A negotiable instrument typically includes a type of contract thatobligates one party to pay a specified sum of money to another party.Negotiable instruments may include checks, money orders, cashier'schecks, drafts, bills of exchange, promissory notes, and the like. Acheck instructs a financial institution to pay an amount of money from aspecific account held in the payor's name with that financialinstitution to an account held in the payee's name. A money order is atrusted financial instrument that is a payment order for a pre-specifiedamount of money. It is a more trusted method of payment than a personalcheck because the funds for the amount shown on the money order must beprepaid. A cashier's check (also known as a bank check, official check,teller's check, bank draft or treasurer's check) is a check guaranteedby a bank and may be purchased from a bank. Cashier's checks are usuallytreated as cash since most banks clear them instantly.

The user 105 may be an individual or entity who owns an account 165 thatmay be held at the institution 200 and is accessible via the institutionsystem 205. The account 165 may be any type of account for depositingfunds, such as a savings account, a checking account, a brokerageaccount, and the like. Although only one account 165 is shown, it iscontemplated that the user 105 may have any number of accounts held atthe institution 200. The user 105 may deposit a check 107 or othernegotiable instrument in the account 165 either electronically orphysically. The institution 200 may process and/or clear the check 107or other negotiable instrument.

The user 105 may communicate with the institution 200 and theinstitution system 205 by way of a communications network 140 such as anintranet, the Internet, a local area network (LAN), a wide area network(WAN), a wireless fidelity (WiFi) network, a public switched telephonenetwork (PSTN), a cellular network, a voice over Internet protocol(Von)) network, and the like. The user 105 may also communicate with theinstitution 200 or the institution system 205 by phone, email, instantmessaging, text messaging, web chat, facsimile, postal mail, and thelike.

The user 105 may remotely electronically deposit the check 107 at theinstitution 200. It is noted that although examples and implementationsdescribed herein may refer to a check, the techniques and systemsdescribed herein are contemplated for, and may be used for, anynegotiable instrument, such as a money order, a cashier's check, a checkguaranteed by a bank, or the like. Similarly, the techniques and systemsdescribed herein are contemplated for and may be used with any form ordocument whose image may be captured with a scanner, camera, or otherimaging device for subsequent storage and/or processing.

The user 105 may access the institution 200 via the institution system205 by opening a communication pathway via the communications network140 using a user computing device 109. There may be several ways inwhich the communication pathway may be established, including, but notlimited to, an Internet connection via a website 218 of the institutionsystem 205. The user 105 may access the website 218 and log into thewebsite 218 using credentials, such as, but not limited to, a usernameand a password.

The user 105 may use an imaging device 115, such as a scanner or camera,to generate a digital image of the check 107. The digital image may beused to create a digital image file 135 that may be sent to theinstitution system 205 and used by the institution 200, in conjunctionwith the institution system 205, to process a deposit of the check 107whose image 137 is comprised within the digital image file 135. In animplementation, the digital image file 135 may be augmented by secondarydata which may be information relating to the deposit of the check 107,such as an account number and a deposit amount, for example.

The user 105 may place the check 107 on a background and generate adigital image comprising an image of the check 107 (e.g., a check image)and a portion of the background (e.g., a background image) using theimaging device 115 or other device such as a camera that may bestandalone or part of a phone or other user computing device, Anybackground may be used. It is noted that although examples andimplementations described herein may refer to a check image and checkdata, the term “check image” may refer to any foreground image in adigital image (as opposed to the background image or replacementbackground image) and the term “check data” may refer to any foregrounddata in a digital image (as opposed to background data such as originalbackground data or replacement background data). Thus, the “check image”and the “check data” may refer to the foreground image and foregrounddata in implementations involving any negotiable instrument, form, ordocument.

In an implementation, the digital image generated by the imaging device115 comprises check data and background data. The check data pertains tothe check image in the digital image and the background data pertains tothe background image in the digital image on which the image of thecheck 107 is displayed. An example of such a digital image is furtherdescribed with respect to FIG. 2. In an implementation, any ratio of thesize of the check image to the size of the background image may be usedwith the example techniques and operations described herein as long asthe digital image comprises both a check image and a background image.

As described further herein, in an implementation, the user computingdevice 109 may comprise an image processing engine 121 that providesreplacement background data (corresponding to a replacement backgroundimage) to the digital image generated by the imaging device 115 in placeof the original background data (which would correspond to an originalbackground image if such an image were generated). An example of such adigital image is further described with respect to FIG. 3. Thebackground may be replaced with a replacement background comprising apredetermined image or color(s). Such a replacement background allowsfor more efficient processing of the check image that is captured withthe imaging device 115. An image comprising a replacement backgroundimage may be more efficiently processed to retrieve check informationtherefrom and to deposit the check associated with the check image.

The edges between the background image and the check image may bedetermined by removing the replacement background image from the digitalimage. The data outside the edges of the check image may be consideredto be background data and may be identified and/or removed as describedfurther herein. In an implementation, the digital image, with thebackground data removed, may be provided as an image 137 of the check107 and provided into a digital image file 135 that may be transmittedto the institution system 205 for deposit of the check 107 in theaccount 165, Thus, the digital image of the check 107 may be providedwith a replacement background, processed to remove the background data,and/or placed into a digital image file at the computing device 109 (orat the institution system 205 in an implementation).

Thus, in an implementation, the user computing device 109 may compriseone or more software modules that receive a digital image from theimaging device 115, provide a replacement background in place of anoriginal background for the digital image, and/or remove the backgroundimage in the digital image (which may be an original background image ora replacement background image depending on the implementation, asdescribed further herein) to provide an image 137 of the check 107. Theimage 137 of the check 107 may be transmitted to the institution system205 for deposit in the account 165.

In an implementation, the background surface on which the check 107 isto be placed for imaging may be analyzed. The user computing device 109may replace the background image (e.g., with one or more predeterminedimages and/or colors) on the generated image so in the generated imageit appears that the check was placed on the replacement backgroundinstead of the original background on which the check was actuallyplaced when the image of the check 107 was taken with the imaging device115.

In an implementation, the image processing engine 121 of the usercomputing device 109 may comprise a background processor 123, a chromakey module 125, an image comparator 127, and an image processor 131.

The background processor 123 may perform various tasks with respect to abackground on which the check 107 may be placed for imaging and/or withrespect to a background in a digital image of the check 107 whichcomprises a check image and a background image. In conjunction with theimaging device 115, the background processor 123 may detect a backgroundon which the check 107 may be placed and/or replace the background imageon which the check 107 is disposed with a replacement background imagein a digital image generated by the scanning device 115. In animplementation, the background processor 123 may analyze the backgroundon which the check 107 is to be placed for imaging and may determinewhich one of a plurality of predetermined replacement background imagesmay be used as a replacement. In an implementation, the backgroundprocessor 123 may store an image of the background (e.g., correspondingto the original background data and/or the replacement background data)in storage associated with the user computing device 109.

In an implementation, instead of the user computing device 109performing the background detection, analysis, replacement and/orstorage, one or more of such operations or tasks may be performed by theinstitution system 205 on a digital image file received from the usercomputing device 109.

In an implementation, chroma key technology may be used to detect theedge of the check image and provide a uniform or consistent replacementbackground for the check image in a digital image, Chroma key is a knowntechnique for mixing two images together, in which a color or colorrange from one image is removed (or made transparent), revealing anotherimage behind it. This technique is also known as color keying,greenscreen, and bluescreen. The chroma key module 125 may use any knownchroma key technique for removing an original background image andreplacing it with (e.g., revealing) a replacement background image.

Alternatively or additionally, the background for the check image may becaptured and the check image may be detected as the difference betweenthe image of the background and the image of the check 107 on thebackground. As described further with respect to the methods 600 and 700for example, the image comparator 127 may compare a digital image of acheck image on a background image (e.g., a replacement background image,an original background image) with just the background image. The imagecomparator 127 may determine the difference and subtract the backgroundimage from the digital image, resulting in a check image without abackground image. In an implementation, instead of the user computingdevice 109 performing the image comparison, the image comparison may beperformed by the institution system 205 on an image file received fromthe user computing device 109.

The image processor 131 may be used to determine an edge of the checkimage in the digital image of the check 107 so that some or the entirebackground image can be removed or disregarded for subsequentprocessing. The image processor 131 may process the image (e.g., asdescribed further herein with respect to the methods 400, 500, 600, and700) and generate a digital image file 135 that may be provided to theinstitution system 205 for deposit of the check 107 represented as animage 137 in the digital image file 135. For example, in animplementation, instead of the user computing device 109 performing theimage processing, the image processing may be performed by theinstitution system 205 on a digital image file received from the usercomputing device 109.

The user 105 may thus generate a digital image of the check 107 usingthe imaging device 115, in an implementation. For example, afterendorsing the check 107, the user 105 may use a device such as theimaging device 115 and/or the user computing device 109 for example, tomake a digital image of the front sides and/or back sides of the check107 and storing the digital image(s) in a digital image file. The imagesof the front side and the back side of the check 107 may be processedusing the techniques described herein. The images may be processed asseparate files or as images in single file. The images of the front sideand the back side of the check 107 may be captured sequentially, e.g.,pursuant to the user 105 flipping the check 107 over after an image ofthe front of the check 107 has been captured.

The digital image file 135 comprising an image 137 of the check may betransmitted to the institution system 205. The user 105 may send thedigital image file 1:35 and any secondary data to the institution system205 along with a request to deposit the check 107 into an account, suchas the account 165. In an implementation, the user 105 may attach thedigital image file 135 to an email and send the digital image file 135to the institution system 205 using the same device used to make thedigital image file 135 of the check 107 or another computing device.However, any technique for sending a digital image file 135 to theinstitution system 205 may be used, such as providing a digital imagefile 135 from storage to the website 218 associated with the institutionsystem 205.

The institution 200 in conjunction with the institution system 205 mayprocess the deposit request according to the digital image file 135 andany secondary data. Thus, the institution 200 in conjunction with theinstitution system 205 may process the digital image file 135 comprisingthe image 137 of the check 107 for deposit.

In an implementation, the institution system 205 may retrieve the image137 of the check 107 from the digital image file 135 and process thecheck 107 from the image 137 for deposit. Any image processingtechnology, software, or other application(s) may be used to retrievethe image 137 of the check 107 from the digital image file 135 and toobtain the relevant data of the check 107 from the digital image file135. The institution system 205 may determine whether the financialinformation associated with the check 107 may be valid.

Upon receipt and processing of the digital image file 135 and approvalof the check 107 associated therewith, the institution 200 may creditthe funds of the check 107 to the account 165. It will be appreciatedthat the examples herein are for purposes of illustration andexplanation only, and that an embodiment is not limited to suchexamples.

The user computing device 109 may be integral with the device used tomake the digital image of the check 107 and/or the digital image file135 or separate from the device used to make the digital image of thecheck 107 and/or the digital image file 135. The user computing device109 may be a personal computer (PC), a handheld computing device, apersonal digital assistant (PDA), a mobile phone, or a smartphone, forexample. The user computing device 109 may comprise an imaging device115 such as a camera, scanner, or other device in which an image of thecheck 107 may be obtained.

In an implementation, the user computing device 109 may be a mobilecomputing device (such as a handheld computing device, a PDA, a mobilephone, a smart phone, a portable PC, etc.) that comprises a camera whichcan capture a digital image of the check 107 by taking a picture of thefront and/or back of the check 107. The back of the check 107 mayprovide endorsement verification, such as the signature of the person orparty the check 107 is made out to. The user 105 may send the digitalimage file 135 to the institution system 205 using the mobile computingdevice. An example user computing device 109 is described with respectto FIG. 8. It is contemplated that any device that is capable ofgenerating a digital image may be used to make a digital image of thecheck 107 which may be processed as described herein for sending to theinstitution system 205 as a digital image file 135. Additional devicesthat may be used in the generation and/or transmission of a digitalimage include a digital camera, a photocopier, a fax machine, and thelike, for example.

Additionally, a video source may be used to capture a video that may beprocessed at the user computing device 109 and/or the institution system205 in accordance with the operations described herein. Such a videosource may include a video camera, a web camera, or a video-enabledphone. A live video or a stored video of the check 107, an originalbackground, and/or a replacement background may be captured, processed,and/or transmitted to the institution system 205 for deposit of thecheck 107.

The institution system 205 may include any combination of systems andsubsystems such as electronic devices including, but not limited to,computers, servers, databases, or the like. The electronic devices mayinclude any combination of hardware components such as processors,databases, storage drives, registers, cache, random access memory (RAM)chips, data buses, or the like and/or software components such asoperating systems, database management applications, or the like,According to an embodiment, the electronic devices may include anetwork-based server that may process the financial information and mayreceive the digital image file 135 from the user 105.

The electronic devices may receive the digital image file 135 and mayperform an initial analysis on the quality of the image of the check 107in the digital image file 135, the readability of the data containedtherein, or the like. For example, the electronic devices may determinewhether the amount payable and other information may be readable suchthat it may be obtained and processed by the institution 205 to creditthe account 165 associated with the user 105.

The institution system 205 may include a user interface module 220, animage processor 222, and a data source access engine 227. The userinterface module 220 may generate and format one or more pages ofcontent 219 as a unified graphical presentation that may be provided tothe user computing device 109 or a representative computing device 187.In an implementation, the page(s) of content 219 may be provided to theuser computing device 109 and/or the representative computing device 187via a secure website 218 associated with the institution system 205.

In an implementation, the institution system 205 may use the imageprocessor 222 to process the digital image file 135 comprising an image137 of the check 107 received from the user 105 for use by theinstitution 200 in the processing and/or clearance of the check 107. Theimage processor 222 may process multiple frames of the image if theimage is comprised of multiple frames (e.g., the front side and the backside of a check).

For example, after receiving the digital image file 135 of the check107, the image processor 222 may retrieve the image(s) 137 of the check107 and process the image 137 or an image based on the image 137 fordeposit. The image processor 222 may use any known image processingsoftware or other application(s) to obtain the image 137 and anyrelevant data of the check 107 from the digital image file 135.

The image processor 222 has access to data, files, and documentspertaining to the user 105 as well as any other data, files, anddocuments that are internal or external to the institution system 205that may be useful in processing the digital image file 135 and/or thedata contained therein.

The institution system 205 has the ability to retrieve information fromone or more data sources 229 via the data source access engine 227. Datapertaining to the user 105 and/or the user account 165 and/or processingand clearing of a check may be retrieved from data source(s) 229 and/orexternal data sources. The retrieved data may be stored centrally,perhaps in storage 208. Other information may be provided to theinstitution system 205 from the user 105 and/or the representative 185.

Data source(s) 229 may contain data, metadata, email, files, and/ordocuments that the institution system 205 maintains pertaining to theuser 105, such as personal data such as name, physical address, emailaddress, etc. and financial data such as credit card numbers andchecking account numbers. Such data may be useful for processing thedigital image file 135. Additionally or alternatively, the institution200 or the institution system 205 may access this information whenprocessing or clearing a check.

The representative computing device 187, as well as the user computingdevice 109, may provide access to a system which is coupled to theinstitution system 205. A system may be configured to format andtransmit a graphical user interface to the representative 185 and/or theuser 105, and through the graphical user interface provide therepresentative 185 and/or the user 105 the ability to interact withinformation that may be maintained, requested, and/or provided by theinstitution system 205, As mentioned above, the institution system 205may provide a unified graphical presentation output. In animplementation, the unified graphical presentation is combined withother materials and transmitted to the representative 185 and/or theuser 105.

A user access system may be implemented as a web server in animplementation. The user access system, through the use of any suitableinteractive web technology, provides an interactive experience to theuser 105 and/or the representative 185 through which access to checkprocessing and clearing data and status and related data can beaccomplished. Any technology that provides interactivity through a webbrowser is considered to be within the scope of the present discussionand may include, without limitation, Hyper-Text Mark-Up Language (HTML),Dynamic HTML (DHTML), JavaScript, and Ajax.

The institution system 205 may comprise one or more computing devices206. The computing device(s) 206 may have one or more processors 207,storage 208 (e.g., storage devices, memory, etc.), and software modules209. The computing device(s) 206, including processor(s) 207, storage208, and software modules 209, may be used in the performance of thetechniques and operations described herein.

Examples of software modules 209 may include modules that may be used inconjunction with receiving and processing a digital image file 135comprising an image 137 of the check 107, retrieving data from thedigital image file 135, generating web page content for display, andreceiving instructions from the representative 185 or the user 105, forexample. While specific functionality is described herein as occurringwith respect to specific modules, the functionality may likewise beperformed by more, fewer, or other modules. An example computing deviceand its components are described in more detail with respect to FIG. 8.

FIG. 2 is a diagram of an example image 250 comprising check data 255(associated with a check image) and original background data 260(associated with an original background image). The image 250 may begenerated by an imaging device associated with the user computing device109, such as the imaging device 115. The image 250 comprises check data255 that is associated with the check 107. The image 250 also comprisesoriginal background data 260 that is associated with the portion of theimage that is not directed to the check 107 (e.g., the background onwhich the check 107 was placed when the image 250 was generated by theimaging device). An edge 257 separates the check data 255 from theoriginal background data 260. The edge 257 may be detected usingtechniques described herein or any known technique(s).

FIG. 3 is a diagram of an example image 300 comprising the check data255 and replacement background data 310 (associated with a replacementbackground image). As described further herein, in an image comprisingthe check data 255, the original background (e.g., corresponding to theoriginal background data 260 of FIG. 2) may be replaced with areplacement background (i.e., the replacement background data 310),either before the image is generated, during image generation, or afterthe image is generated.

FIG. 4 is an operational flow of an implementation of a method 400 thatmay be used to detect a check. At 402, an account owner (i.e., thepayee, referred to herein as a user) may receive a check from a thirdparty (i.e., the payor) and may endorse the check by signing the back ofthe check in the designated field. If the user wishes to deposit thecheck into an account, such as a savings and/or checking account, theyalso may write an account number below the signature.

At 404, the user may open a communication pathway with an institutionthat may be associated with an account for depositing funds by logginginto a website of the institution, for example. There may be severalways in which a communication pathway may be established, including, butnot limited to, an Internet connection via a website of the institution.The user may access the website and log into the website usingcredentials, such as, but not limited to, a username and a password.

At 406, the user may send a request to deposit the check and may selectan account in which to deposit the check. In an implementation, the usermay select a “deposit check” option provided on the website, and mayenter details such as check amount, date, the account the check fundsshould be deposited in, comments, etc.

At 410, the background that the check is to be placed on for generationof a digital image may be detected by the imaging device. The imagingdevice may be directed to the background onto which the check will beplaced and may detect the background. Such detection may compriseidentifying features of the background, such as brightness,reflectivity, colors, images, patterns, etc. using known featureidentification techniques. Such features may be maintained in storagepertaining to original background data. Alternatively or additionally,the detection may comprise capturing an image of the background andstoring the image of the background in storage associated with theimaging device.

For detection of the background, the distance between the imaging deviceand the background is approximately equal to the distance that will beused between the imaging device and the check when an image of the checkis to be created. In this manner, the background may remain constant inappearance for the background detection and the digital image generationoperations.

The imaging device may be directed to the background by the user or asoftware application or module operating in conjunction with the imagingdevice or an associated user computing device or computing device of theinstitution. Similarly, the imaging device may perform the detection ofthe background with a software application or module operating inconjunction with the imaging device or an associated user computingdevice or computing device of the institution (e.g., the backgroundprocessor 123, the computing device(s) 206, the processor(s) 207, thesoftware modules 209, and/or the image processor 222).

At 420, a replacement background may be identified (e.g., by the usercomputing device 109, the imaging device 115, the background processor123, the computing device(s) 206, the processor(s) 207, the softwaremodules 209, and/or the image processor 222) to replace the backgroundin a subsequently created digital image comprising an image of thecheck. The replacement background may be predetermined or dynamicallygenerated e.g., based on the detected background of 410. In animplementation, the replacement background may be retrieved from storageand/or generated and maintained for placement on the digital imagecomprising the image of the check.

At 430, a digital image of the check on the replacement background maybe created. An image of the check on the replacement background insteadof on the original background may be generated using the imaging device.For example, the check may be shown in the digital image on apredetermined background (e.g., a dark background, a backgroundcontaining a logo of the institution, etc.) instead of the truebackground that the check was placed on during the imaging of the check.

There may be several ways in which to create a digital image of thecheck, including, but not limited to, a scanner, a digital camera,and/or a PC. The user may place the check on a background and use thescanner, camera, or other imaging device to create a digital imagecomprising an image of the check and a background. In an implementation,the user may scan or otherwise create a digital image file comprisingthe front side of the check and the back side of the check.

In an implementation, chroma key technology may be used to generate andinsert the replacement background as a replacement for (e.g., over or inplace of) the original background in the digital image of the check on abackground. Alternatively or additionally, edge detection and/or otherbackground identification techniques may be used to determine where toinsert the replacement background in place of the original background inthe digital image. Such techniques as well as chroma key technology mayuse the original background data pertaining to the detected backgroundof 410.

At 440, the image of the check on the replacement background may beprocessed using known techniques, e.g., to remove warping or dewarp theimage, to crop the image, to deskew the image (e.g., rotate the image tohorizontal), to identify the corners, etc. In an implementation, certainpoints or features (e.g., MICR (magnetic ink character recognition)number, “$” sign, signature line, courtesy amount line, legal amountline, etc.) of the check may be identified and used in lining up orotherwise arranging or processing the image of the check. It iscontemplated that any points, coordinates, features, or regions ofinterest on a negotiable instrument may be used with the techniquesdescribed herein. Additionally or alternatively, processing may beperformed to remove some or the entire background data. In this manner,in an implementation, an image may be formed that primarily comprisescheck data and comprises very little, if any, background data.Additionally or alternatively, edge detection may be used to identifythe edges of the image of the check. Any known edge detection techniquemay be used.

The resulting processed image may be saved as a digital image file at450 and sent to the institution at 460. The digital image file may besent using various means, including, but not limited to, an Internetconnection via the website or a cellular transmission. Additionally, thedigital image file may be augmented by secondary data which may beinformation relating to the check, such as an account number, a depositamount, or a routing number associated with the check, and/or relatingto the account for depositing funds, such as the account number and/orthe name on the account. The secondary data may be provided to theinstitution via an image file, an email, a facsimile, instant message,text message, or selection via a website associated with the institution(e.g., after the user opens a communication pathway with theinstitution, before or after the user sends the digital image file theinstitution, etc.), for example.

At 470, the institution may receive the digital image file comprisingthe image of the check (along with financial information pertaining tothe account for depositing funds and any secondary data in animplementation) and may process the digital image file. Processing ofthe digital image file may include retrieving financial informationregarding the check. The financial information may comprise the MICRnumber, the routing number, an amount, etc. Any known image processingtechnology may be used, such as edge detection, filtering to removeimagery except the check image or check data in the received digitalimage file, image sharpening, and technologies to distinguish betweenthe front and the back sides of the check. The institution may identifyand/or remove at least a portion of data that is extraneous to thecheck, such as background data.

After retrieving the financial information from the check in anelectronic data representation form, the institution may determinewhether the financial information such as the amount payable to theuser, the account associated with the user to deposit funds, an accountassociated with a payor to debit funds, and an institution associatedwith the payor, etc., may be valid. For example, the institution mayinclude electronic devices such as computers, servers, databases, or thelike that may be in communication with each other. The electronicdevices may receive an electronic data representation and may perform aninitial analysis on the quality of the data representation, thereadability of the data representation, or the like. For example, theelectronic devices may determine whether the account number, amountpayable, or the like may be readable such that they may be parsed andprocessed by the institution to credit an account associated with theuser.

If the financial information is determined to be valid, the electronicdata representation may be processed by the institution, therebydepositing the money in the user's account. If the financial informationis determined to be invalid, then the user may be advised For example,the institution may transmit an email, a web message, an instantmessage, or the like to the user indicating that the financialinformation associated with the electronic data representation may beinvalid. The user may determine how to proceed by selecting an option onthe web message, replying to the email, or the like.

Thus, in an implementation, instructions on how the user would like toproceed may be requested from the user, such as whether the user wouldlike to try the deposit again (e.g., make another digital image file andsend it to the institution) or whether the user would like assistancefrom a representative, for example. The user may indicate how they wouldlike to proceed.

If the user would like assistance, the financial information may betransferred to a representative for further review. The representativemay review the financial information associated with the electronic datarepresentation to determine whether to allow the electronic datarepresentation to be processed by the institution. If so, the electronicdata representation of the financial information may be processed by theinstitution, thereby depositing the check in the user's account. Theinstitution may send a notice to the user via email, facsimile, instantmessage, or mail, for example, that the check has been deposited intothe selected account.

FIG. 5 is an operational flow of another implementation of a method 500that may be used to detect a check. At 510, the background that thecheck is to be placed on for generation of a digital image may bedetected by the imaging device. This operation is similar to thatdescribed at 410 and its further description is omitted for brevity.

At 520, one or more features of the check may be determined by theimaging device or a computing device operating in conjunction with theimaging device (e.g., along with one or more software applications ormodules, the background processor 123, the computing device(s) 206, theprocessor(s) 207, the software modules 209, and/or the image processor222, depending on the implementation). In an implementation, thebrightness, reflectivity, colors, images, and/or patterns on the checkmay be determined using known feature identification techniques.

At 530, one of a plurality of backgrounds may be determined to be areplacement background. The determination may be made based on ananalysis of the background onto which the check will be placed (e.g.,features of the background) and/or the features of the check. Theanalysis may be made by the imaging device or a computing deviceoperating in conjunction with the imaging device (e.g., a user computingdevice, a computing device of the institution).

The plurality of backgrounds from which the replacement background maybe determined (e.g., selected) may be maintained in storage that isaccessible to the imaging device and/or the computing device and may beretrieved from the storage. In an implementation, a replacementbackground may be dynamically generated based on the analysis of thefeatures of the background onto which the check will be placed, thefeatures of the check, and/or one or more backgrounds that may bemaintained in storage.

In an implementation, a replacement background may be determined thatincreases or maximizes the contrast between the color of the check andthe background. In another implementation, it may be determined if afirst replacement background (e.g., an image with a logo or brandinginformation, a patterned image, etc.) may provide acceptable contrast(e.g., for subsequent edge detection and/or processing of the digitalimage of the check image and the replacement background image that willbe created). If so, then the first replacement background may bedetermined to be the replacement background; otherwise, a secondreplacement background (e.g., a consistently colored image, a darkcolored image, a black image, etc.) may be determined and a digitalimage of the check on the replacement background may be created. Thedetermined replacement background may be maintained for subsequentplacement on the digital image comprising the image of the check.

Processing may continue at 430 of the method 400 described with respectto FIG. 4 with a digital image of the check on the replacementbackground being created.

FIG. 6 is an operational flow of another implementation of a method 600that may be used to detect a check. At 610, the background that a checkis to be placed on may be detected by the imaging device. At 620 and630, a replacement background may be identified and an image of thecheck on the replacement background may be generated using the imagingdevice. These operations are similar to those described at 410, 420, and430, respectively, and their further descriptions are omitted forbrevity.

At 640, the difference may be determined between the image of the checkon the replacement background (created at 630) and the replacementbackground. The difference may be used to generate a digital imagecomprising only the check image without the replacement background (orwith a reduced amount of replacement background present in the digitalimage). This may allow for more efficient processing and transmission ofthe check image.

An image comparator, associated with an imaging device and/or acomputing device of the user or the institution depending on theimplementation, may determine the difference by comparing the digitalimage created at 630 with an image of the replacement backgroundidentified at 620. In an implementation, an image of the replacementbackground alone (e.g., without the check image) may be created, stored,and used in the difference determination. The image comparator maysubtract the background image from the digital image created at 630,resulting in a digital image comprising a check image without abackground image.

Thus, in an implementation, all of the replacement background image maybe removed, resulting in a digital image that only comprises the checkimage. In another implementation, a portion of the replacementbackground may not be removed and may remain in the resulting digitalimage (e.g., in order to provide an edge around the check image that maybe used in subsequent processing).

The resulting digital image of the check image may be processed at 650in a manner similar to that described with respect to 440, for example,and saved as a digital image file. In an implementation, the digitalimage file may be sent to the institution at 660 for processing.Alternatively, the institution may perform the operations at 640 and 650and may thus have the digital image file comprising the processed imageafter operation 650. At 670, the institution may process the digitalimage file, as described further with respect to 470 for example, anddeposit the check represented by the check image into the account of theuser.

FIG. 7 is an operational flow of another implementation of a method 700that may be used to detect a check. At 710, similar to 410, thebackground that a check is to be placed on may be detected by theimaging device. At 720, a digital image of the check on the backgroundmay be created used an imaging device.

At 730, the difference may be determined between the image of the checkon the background in the digital image and the background on which theimage was placed. The difference may be determined using an imagecomparator described further above. Similar to 640, the difference maybe used to generate a digital image comprising only the check imagewithout the background or with a reduced amount of background present inthe digital image, allowing for more efficient processing andtransmission of the check image, for example. Depending on theimplementation, the image comparator may subtract some or the entirebackground image from the digital image created at 720, resulting in adigital image comprising a check image without some or all of thebackground image. Processing may proceed as described in the method 600at 650.

FIG. 8 shows an exemplary computing environment in which exampleembodiments and aspects may be implemented. The computing systemenvironment is only one example of a suitable computing environment andis not intended to suggest any limitation as to the scope of use orfunctionality.

Numerous other general purpose or special purpose computing systemenvironments or configurations may be used. Examples of well knowncomputing systems, environments, and/or configurations that may besuitable for use include, but are not limited to, personal computers,server computers, handheld or laptop devices, multiprocessor systems,microprocessor-based systems, network PCs, minicomputers, mainframecomputers, embedded systems, distributed computing environments thatinclude any of the above systems or devices, and the like.

Computer-executable instructions, such as program modules, beingexecuted by a computer may be used. Generally, program modules includeroutines, programs, objects, components, data structures, etc. thatperform particular tasks or implement particular abstract data types.Distributed computing environments may be used where tasks are performedby remote processing devices that are linked through a communicationsnetwork or other data transmission medium. In a distributed computingenvironment, program modules and other data may be located in both localand remote computer storage media including memory storage devices.

With reference to FIG. 8, an exemplary system for implementing aspectsdescribed herein includes a computing device, such as computing device800. In its most basic configuration, computing device 800 typicallyincludes at least one processing unit 802 and system memory 804.Depending on the exact configuration and type of computing device,system memory 804 may be volatile (such as RAM), non-volatile (such asread-only memory (ROM), flash memory, etc.), or some combination of thetwo. This most basic configuration is illustrated in FIG. 8 by dashedline 806.

Computing device 800 may have additional features and/or functionality.For example, computing device 800 may include additional storage(removable and/or non-removable) including, but not limited to, magneticor optical disks or tape. Such additional storage is illustrated in FIG.8 by removable storage 808 and non-removable storage 810.

Computing device 800 typically includes a variety of computer-readablemedia. Computer-readable media can be any available media that can beaccessed by computing device 800 and includes both volatile andnon-volatile media, and removable and non-removable media. By way ofexample, and not limitation, computer-readable media may comprisecomputer storage media and communication media.

Computer storage media include volatile and non-volatile, and removableand non-removable media implemented in any method or technology forstorage of information such as computer-readable instructions, datastructures, program modules or other data. System memory 804, removablestorage 808, and non-removable storage 810 are all examples of computerstorage media. Computer storage media include, but are not limited to,RAM, ROM, Electrically Erasable Programmable Read-Only Memory (EEPROM),flash memory or other memory technology, CD-ROM, digital versatile disks(DVD) or other optical storage, magnetic cassettes, magnetic tape,magnetic disk storage or other magnetic storage devices, or any othermedium which can be used to store the desired information and which canbe accessed by computing device 800. Any such computer storage media maybe part of computing device 800.

Computing device 800 may also contain communication connection(s) 812that allow the computing device 800 to communicate with other devices.Communication connection(s) 812 is an example of communication media.Communication media typically embody computer-readable instructions,data structures, program modules, or other data in a modulated datasignal such as a carrier wave or other transport mechanism, and includeany information delivery media. The term “modulated data signal” means asignal that has one or more of its characteristics set or changed insuch a manner as to encode information in the signal. By way of example,and not limitation, communication media include wired media such as awired network or direct-wired connection, and wireless media such asacoustic, radio frequency (RF), infrared, and other wireless media. Theterm computer-readable media as used herein includes both storage mediaand communication media.

Computing device 800 may also have input device(s) 814 such as akeyboard, mouse, pen, voice input device, touch input device, etc.Output device(s) 8:16 such as a display, speakers, printer, etc. mayalso be included. All these devices are well known in the art and neednot be discussed at length here.

Computing device 800 may be one of a plurality of computing devices 800inter-connected by a network. As may be appreciated, the network may beany appropriate network, each computing device 800 may be connectedthereto by way of communication connection(s) 812 in any appropriatemanner, and each computing device 800 may communicate with one or moreof the other computing devices 800 in the network in any appropriatemanner. For example, the network may be a wired or wireless networkwithin an organization or home or the like, and may include a direct orindirect coupling to an external network such as the Internet or thelike.

It should be understood that the various techniques described herein maybe implemented in connection with hardware or software or, whereappropriate, with a combination of both. Thus, the methods and apparatusof the presently disclosed subject matter, or certain aspects orportions thereof, may take the form of program code (i.e., instructions)embodied in tangible media, such as floppy diskettes, CD-ROMs, harddrives, or any other machine-readable storage medium wherein, when theprogram code is loaded into and executed by a machine, such as acomputer, the machine becomes an apparatus for practicing the presentlydisclosed subject matter. In the case of program code execution onprogrammable computers, the computing device generally includes aprocessor, a storage medium readable by the processor (includingvolatile and non-volatile memory and/or storage elements), at least oneinput device, and at least one output device. One or more programs mayimplement or utilize the processes described in connection with thepresently disclosed subject matter, e.g., through the use of anapplication programming interface (API), reusable controls, or the like.Such programs may be implemented in a high level procedural orobject-oriented programming language to communicate with a computersystem. However, the program(s) can be implemented in assembly ormachine language, if desired. In any case, the language may be acompiled or interpreted language and it may be combined with hardwareimplementations.

Although exemplary embodiments may refer to utilizing aspects of thepresently disclosed subject matter in the context of one or morestand-alone computer systems, the subject matter is not so limited, butrather may be implemented in connection with any computing environment,such as a network or distributed computing environment. Still further,aspects of the presently disclosed subject matter may be implemented inor across a plurality of processing chips or devices, and storage maysimilarly be effected across a plurality of devices. Such devices mightinclude personal computers, network servers, and handheld devices, forexample.

Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described above.Rather, the specific features and acts described above are disclosed asexample forms of implementing the claims.

What is claimed:
 1. A method for replacing a background image portion ofa digital image that includes a financial document image portion and thebackground image portion, the method comprising: in a processor:receiving the digital image, the digital image including the financialdocument image portion and the background image portion; detecting thebackground image portion; selecting a replacement background imageportion, from a plurality of background images, that maximizes acontrast between a color of the financial document image portion and thereplacement background image portion; replacing at least a portion ofthe background image portion from the digital image with at least aportion of the selected replacement background image to generate anupdated digital image; and storing the updated digital image in a memoryin communication with the processor.
 2. The method of claim 1, whereindetecting the background image portion is based on at least one featureof the background image.
 3. The method of claim 1, wherein detecting thebackground image portion comprises: accessing a stored background image;and detecting the background image portion by determining a differencebetween the stored background image and the received digital image. 4.The method of claim 1, wherein replacing at least a portion of thebackground image portion comprises dynamically generating thereplacement background image based on analysis of at least one of thebackground image portion or the financial document image portion.
 5. Themethod of claim 1, wherein replacing at least a portion of thebackground image portion comprises analyzing multiple replacementbackgrounds in order to select one of the multiple replacementbackgrounds as the replacement background.
 6. The method of claim 5,wherein the multiple replacement backgrounds include a consistentlycolored image and an inconsistently colored image.
 7. The method ofclaim 1, wherein: the financial document image portion comprises animage of a check; transmitting the updated digital image to aninstitution for processing to deposit the check into an account; andremoving or replacing at least a portion of the background image portionis performed prior to transmitting the updated digital image.
 8. Themethod of claim 1, further comprising removing, from the updated digitalimage, at least a part of the replacement background image.
 9. Themethod of claim 8, wherein removing, from the updated digital image, atleast a part of the replacement background image comprises determining adifference between the updated digital image and the replacementbackground image.
 10. The method of claim 9, wherein determining adifference between the updated digital image and the replacementbackground image comprises subtracting the replacement background imagefrom the updated digital image in order to generate a final digitalimage comprising the financial document image portion without at least aportion of the replacement background image.
 11. The method of claim 1,further comprising: generating the digital image using a portablescanning device; and sending the digital image to the processor.
 12. Anapparatus for replacing a background image portion of a digital image,the apparatus comprising: a memory storing executable instructions; anda processor configured to be in communication with the memory, andconfigured to execute the instructions to: receive the digital image,the digital image including a financial document image portion and thebackground image portion; detect the background image portion; select areplacement background image portion, from a plurality of backgroundimages, that maximizes a contrast between a color of the financialdocument image portion and the replacement background image portion;replace at least a portion of the background image portion from thedigital image with at least a portion of the selected replacementbackground image to generate an updated digital image; and store theupdated digital image in a memory in communication with the processor.13. The apparatus of claim 12, further comprising a scanner incommunication with the processor and configured to generate the updateddigital image.
 14. The apparatus of claim 13, wherein the apparatuscomprises a mobile computing device; and further comprising atransmitter to transmit the updated digital image.
 15. The apparatus ofclaim 12, wherein the processor is configured to execute theinstructions to detect the background image portion by: accessing astored background image; and detecting the background image portion bydetermining a difference between the stored background image and thereceived digital image.
 16. The apparatus of claim 15, wherein theprocessor is configured to execute the instructions to replace the atleast a portion of the background image portion by removing at least aportion of the background image portion by subtracting the determineddifference between the stored background image and the received digitalimage.
 17. The apparatus of claim 12, wherein the processor isconfigured to execute the instructions to replace at least a portion ofthe background image portion based on at least one feature of backgroundimage portion.
 18. The apparatus of claim 12, wherein the processor isconfigured to execute the instructions to replace at least a portion ofthe background image portion based on at least one feature of thefinancial document image portion.
 19. The apparatus of claim 12, whereinthe processor is configured to execute the instructions to replace atleast a portion of the background image portion by: analyzing at leastone of the background image portion or the financial document imageportion; and dynamically generating the replacement background imagebased on the analysis.
 20. The apparatus of claim 12, wherein theprocessor is configured to execute the instructions to replace at leasta portion of initial background image portion by selecting thereplacement background image based on at least one difference betweenthe background image portion and the financial document image portion.